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Abstract 

In this paper we obtain two results for the Sherrington-Kirkpatrick 
(SK) model, and we show that they both emerge from a single ap- 
proach. First, we prove that the average of the overlap takes positive 
values when it is non zero. More specificly, the average of the over- 
lap, which is naively expected to take values in the whole interval 
[—1, +1], becomes positive if we "first" apply an external field, so to 
destroy the gauge invariance of the model, and "then" remove it in 
the thermodynamic limit. This phenomenon emerges at the critical 
point. This first result is weaker than the one obtained by Talagrand 
(not limited to the average of the overlap), but we show here that, at 
least in average, the overlap is proven to be non-negative with no use 
of the Ghirlanda-Guerra identities. The latter are instead needed to 
obtain the second result, which is the control the behavior of the 
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overlap at the critical point: we find the critical exponents of all the 
overlap correlation functions. 

1 Introduction 

Mean field spin glass models are a very hard "challenge for mathematicians" 
[TTj . In fact, despite the important fact that the free energy is known 
(predicted by Parisi and rigorously proven by Talagrand), very little is 
proven about their organization into pure states at low temperature except 
for high temperature regimes. Only a sequence of brilliant intuitions of 
Parisi (see [9] and references therein) provided a proposal for a theory of 
disordered systems, which is comforted by many numerical studies (see 
for example [5]), but many of the intuitions still lack a rigorous proof. 
Among the many stimulating suggestions, Parisi prescribed the positivity 
of the overlap below the critical temperature, which breaks the symmetry 
by which the overlap should be trivially zero (in absence of an external 
field). More precisely, the average of the overlap is zero when there is no 
external field, by spin-flip symmetry. If an external field is applied, the 
spin-flip symmetry is broken and the average of the overlap is non-zero. 
When the external field is removed the average of the overlap remains 
strictly positive, below the critical temperature. This is what we prove 
here (slightly more, to be precise, as we will use a random external field as 
opposed to a constant one) in agreement with what Parisi predicted. This 
result is weaker than what Talagrand proved , namely that the overlap 
is non-negative with the possible exception of a zero Lebesgue measure set 
of the parameters. This is shown to be a consequence of the Ghirlanda- 
Guerra identities [4]. Here we show that at least the weaker result can be 
proven in a "very physical" and simple way. Moreover, the technique offers 
another result, of crucial physical relevance, i.e. the critical exponents of 
the behavior of the overlaps at the critical point. 
We will focus on the following points 
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1. spin-flip symmetry breaking due to an external field; 

2. strict positivity of the average of the overlap below the critical tem- 
perature; 

3. gauge symmetry breaking due to an external field; 

4. critical exponents in connection with the gauge symmetry breaking. 

The procedure we employed to prove these results makes use of an it- 
erative approach to expand the average of the overlap in a power series of 
the strength of the external field. Within a framework typical of cavity ap- 
proaches, we also take advantage of some known symmetries of the model, 
which we report together with the definition of the model in section [2j 
The main results are presented in sections [3] and 01 where the positivity of 
the overlap and the critical exponents are studied respectively. Conclusive 
remarks are left for section [5] 

2 Model, notations, previous results 

The Sherrington-Kirkpatrick (SK) model describes a system of N binary 
spins <7j, i € (1, . . . , N). A configuration a of the system is then a map 



The Hamiltonian of the model is defined to assign the following energy to 
a given configuration a: 



where the sum ranges over all the N(N — l)/2 different couples of indices 
and Jij are independ centered unit Gaussian random variables. The 
partition function is defined as usual by 



a:{l,2,...,N}3i 



a, e {-!,+!} • 




(7 
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while the Boltzmann-Gibbs expectation of an observable A : a — > M is 

= Z N {(3-J) E A(fT) CX P(-^^; J )) • 

The global average (over the spins first and the noise in the couplings af- 
terwards) is (•) = Ew(-), where E denotes the expectation with respect to 
all the (quenched) Gaussian variables. The notation for the averages does 
not specify any dependence on the size of the system, and we will occa- 
sionally use the same symbols in the thermodynamic limit too, specifying 
this when needed. By ft we denote the product measure (replica measure) 
of the needed number of copies of u>, which we will use when dealing with 
functions of several configurations (replicas). Notice that while f2 is fac- 
torized by definition, (•) is not, as we are just replicating configurations, 
keeping for each the same disorder (i.e. Gaussian couplings). Taking the 
same disorder results in coupling the various replicas and therefore E de- 
stroys the factorization. Given two replicas and we define the 
overlap between them as 

1 (!) ( 2 ) 

^ = N2^ a i °i > 

sometimes simply written as q. The pressure ajv(/?) and the free energy 
per spin Jn(P) arc defined as 

a N ((3) = -(3f N ((3) = ±ElnZ N (p) . 

By a trivial (spin- flip) symmetry argument, one readily sees that (for all 
inverse temperature /?) 

9i2 e [-1,1], («i2> = o. 

When an external field is applied, i.e. a term of the form V^SiLi J% a i 
for J e A/"(0, 1) and x € M+ is added to the Hamiltonian, the spin-flip 
symmetry is broken and the overlap will be different from zero in average. 
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Parisi theory [5] prescribes a phase transition such that even an infinitesi- 
mal external field will force the overlap to be supported on [0,1], and the 
limit as x — > + of the average of the overlap is positive: 

lim (q 12 ) > , @ > (3 C 

where (3 C is the critical inverse temperature and clearly the dependence on 
x of the measure (•) = Kuj(-) is here in the Boltzmannfaktor in u, which 
includes the external field term in addition to the original Hamiltonian. 
For the sake of clarity, we will sometimes attach a sub x to the measures, 
when they include the external field. 

2.1 Some useful results 

The next two propositions, which we do not provide the easy proof of, will 
be of precious help. 

Proposition 1 The average (•) is invariant under replica symmetry: let g 
be any element of the group G of permutations of s objects, then 

(Hlab)) = (<t>{q g (a)g(b))) 

for any function (f> of two generic replicas and all a, b € {1, . . . , s}. 
Proposition 2 The average (•) is invariant under gauge symmetry: 

of - * faff," , lab — * e a £bqab 

being e a , = ±1 . 

This symmetry is a consequence of the parity of the state u> and of the 
dichotomic nature of the spin, so it is obviously guaranteed by the spin-flip 
symmetry of the Hamiltonian for each single replica in f2. 

We will have to compute several averages of polynomials of overlaps, 
but will see that the average of certain polynomials are easy to compute. 
That is why the following classification comes in handy. 
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Definition 1 A polynomial function of some overlaps is said 

• filled if every replica appears an even number of times in it; 

• fillable if it can be made filled multiplying it by exactly one overlap 
of two replicas; 

• unfillable if it is neither filled nor fillable. 

A consequence of the gauge invariance of the model is that the average of 
non filled polynomials (fillable as well as unfillable) is identically zero. The 
reason is that the absence of an external field guarantees gauge invariance, 
and non-filled polynomials are asymmetric in one of the overlaps and av- 
erages of products of spins belonging to different replicas are zero by the 
symmetries above. Consequently in this case the probability distribution 
of functions of overlaps is uniquely determined by its restriction to the pos- 
itive semi-domain [0, 1]. The general case, at zero external field, in which 
q e [—1, +1], is obtainable simply by employing the gauge. 

3 Discontinuity of the order parameter 

In order to establish the presence of a discontinuity in the overlap due to 
an infinitesimal external field, we employ some kind of cavity method and 
stochastic stability techniques. Namely, we add a random perturbation (as 
the one described above) which can be equivalent either to a deterministic 
external field or to the addition of a new spin (depending on the choice of 
the parameters), and we then study the consequences of the spontaneous 
breaking of the spin-flip and gauge symmetries. 

3.1 The external field and non-negativity of the aver- 
age of the overlap 

Before proceeding, in the next subsection, with the introduction of the main 
techniques, let us introduce the needed external field which breaks the spin- 
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flip symmetry of the Hamiltonian and hence of uj. Consider a family {Ji} of 
N centered unit Gaussian independent random variables. The expectation 
with respect to these (quenched) variables will be included in E. Let us 
introduce consequently the following Boltzmannfaktor 

B(x) = exp ( - /3H N (a; J) + y/x^ Ji°~i ) ■ 
^ i=i ' 

We will here denote the corresponding Gibbs measure by u) x , and {-) x = 
Ew x (-). In the following we will be interested in letting x go to zero as 
TV -1 while N goes to infinity. This is the only way to recover the correct 
normalization for a Hamiltonian of N + 1 spins (that is the proper weight 
of the Boltzmann factor B(x) if the gauge symmetry holds), and it is what 
is technically needed to get our main result, as it will emerge. 

Let us now report a result that generalizes slightly the analogous one 
proven in [2]. 

Proposition 3 In the N — ► oo limit the average (-) x of filled polynomials 
is x -independent, i.e. ((712923913)2; = (912923913), when integrated over any 
interval [/3i,/?2] 9 P, with the exclusion of a zero Lebesgue measure set 
of values of /3. 

We are not going to prove this proposition, as it obtainable as a special 
case of the next one, which will be proven here. 

Theorem 1 Let Q a b be a fillable polynomial of some overlaps (this means 
that q a bQab * s filled). Then 

lim lim (Q ab ) x = (q a bQab) , 

where the right hand side too is understood to be taken in the thermody- 
namic limit. 

The proof requires the following 
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Lemma 1 Letuj(.) anduj x {.) be the states defined respectively by the canon- 
ical partition function and by the extended one; if we consider the ensemble 
of index .., i r } with r e [1, N], then in the limit x = 1 /N the following 
relation holds: 

x—>p z /N 1\ 

In this statement r is an exponent, not a replica index, so if r is even cr]v+i = 
1, while if it is odd cr 7 N+1 = <tn+i and we emphasized the dependence on 
iV or N + 1 in the two averages for clarity. 

Proof For the sake of simplicity let us put a = a il ...<7i r , and for x — f3 2 /N 
we have 

1 f3 hN 

Ux=P*/n(°L) = z JJs eXp ("7^(5Z • / '.' rr '' T ' + Yl J i a i))3- ■ 

Introducing a sum over ct/v+i at the numerator and at the denominator 
(which is the same as multiplying and dividing by 2 N because there is no 
dependence on <tjv+i), and making the transformation cr, — * Ci<7 jv+ij the 
variable (Tat+i appears at the numerator and it is possible to construct the 
state u; for N + 1 particles: 

Proof of Theorem Q] A fillable polynomial will be taken of the form 

a a a h 

Qab = Y ~^2 L( 3y( cr ) ' 

so that the a, b are the non-filled replicas, fillable by q a i,, and the filled 
replicas are included in the Qi/s. We have 

{Qab) t = j^nYntK^Q^o-))] = ^YL^ a i) u M)^{Qij)] ■ 

ij ' ij 

We will now take x = [3 2 /N and use the previous lemma to get 
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while the remaining part product state fi x continues to act on an even 
number of each replica and it is not modified: 

Qx=/3 2 /N(Qij) — Q{Qij) ■ 

Hence 

Using the dummy summation variable <tjv+i [5] we can also sum over all 
dumb indexes from 1 to N and divide by N, because the involved terms 
are of order O(jj) and become irrelevant in the N — > oo limit. Therefore 

ijk 

and in the thermodynamic limit we complete the proof. □ 
If we now let x — * + as (3 2 /N, N — + oo we immediately get 

Corollary 1 Let (3 > (3 C! then 

Jim {q) x =pz/N > • 

Proof This is the simple case of the fillable polynomial Q = q in the 
previous theorem, which offers lmiN- t x(q}x=i3 2 /N = hmjv^oo^ 2 ) > 0, 
which becomes a strict inequality below the critical point. □ 

The corollary shows that the the non-negativity of the average of the 
overlap can be easily proven with a simple cavity argument with no need 
of the Ghirlanda-Guerra relations, which are instead needed to prove the 
non- negativity of the overlap with probability one [llj . 

We are interested in studying the behavior of the overlap at the critical 
point, where the overlap begins to fluctuate. In order to do so, we will 
have to pay a price: we need to provide a more involved proof of an even 
weaker statement than that of the previous corollary. This will pave the 
way to a new proof of the corollary which also offers a control of the critical 
behavior of the overlap. 
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3.2 The expansion and the spin-flip symmetry break- 
ing 

We arc interested in obtaining an expansion of the overlap (912) in a neigh- 
borhood of the critical inverse temperature (3 C - 

The right way to perform the expansion is indicated by the next 

Proposition 4 Let 4> s be measurable with respect to the a-algebra A s gen- 
erated by the overlaps among s replicas, then the following streaming equa- 
tion for (f> 8 holds: 

s 1 

d x (4>s)x = N((f) s (^2q atb - s^q a:S+ i + -s(s + l)q s+liS+2 )) x 

a,b a=l 

where all the averages are considered at any given size of the system N . 

This proposition is a straightforward generalization of the streaming equa- 
tion proved in [6] . Throughout the section all the averages are understood 
to be taken at fixed finite N . If we use the proposition above in the simple 
case cj> = q, we obtain immediately 

d x {qi2)x = N{q\ 2 - 4qi2<723 + iqi2qsi)x , (2) 

which at x = reduces to N(q1 2 ) (with a violation of Ghirlanda-Guerra 
identities [4] in the thermodynamic limit) and explodes as N — > 00, while 
it remains finite when x > 0. We will get back to this later on. 

It is from the above identity (J2]) that we will deduce a weaker form of 
Corollary [1] as stated in the next 

Theorem 2 Let x — y 2 /N and (3 > (3 C . Then, for sufficiently small but 
non-vanishing y 

Jim (qi2) x =y 2 /N > • 

Proof We are going to give place to an iterated expansion, about the 
critical point [3 C , by means of a repeated use of Proposition [H relying also 
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on Proposition [3J The right hand side of © consists of three terms. The 
first term is (the average of) the filled polynomial (q 2 2 ) x , which, as we 
noticed, does not depend on x and hence 

(qi2)x = N ((qf 2 )x - 4: J dx' {qi 2 q 23 ) x > + Z J dx 1 ' (qi 2 q 3 4) x'J ■ (3) 

We want to show that the two terms under integral are of order higher 
than the first in x. We will perform this task for the first term (the case of 
the second is analogous) using again Proposition 2J 

Ql2Q23/ X = N(q 12 q 23 q 13 ) x +0{x 3 ) . (4) 

Recalling the mentioned properties of filled polynomials, we immediately 
see that equation ((H) gives 

(qi2q23)x = N I (qi 2 q23qi3)x'dx' = N(q 12 q 23 q 13 )x . 
Jo 

so that consequently 

X pX 

dx' {qi 2 q 23 ) x > = \ dx'N(q 12 q 23 q 13 ) x ,x' + 0(x 3 ) . 
Jo 

Therefore the leading contribution from (qi 2 q23}x in © is (912923913) N 2 x 2 , 
i.e. a contribution of order two in x. An identical consideration tells us 
that the contribution from the last term in equation (J3J) is of three in x. 
Neglecting terms of order x A or higher one thus gets 

(912). = N(q 2 12 )x - 2N 2 (q 12 q 23 q 13 )x 2 - 

- ^N 3 (q 2 12 q 2 3 )x 3 + N 3 (q 2 12 ql 4 )x 3 + 6N 3 (q 12 q 23 q 34 q 14 )x 3 + ■■■ (5) 

Notice that for a given strictly positive x, the above expansion diverges 
below the critical temperature (we will comment further on this at the end 
of the section) as N — > 00, so that such an expansion makes sense only if 
x — > + as N — > 00 (this is true within our spin-flip symmetry breaking 
approach, and we will see later how to bypass this restriction studying the 
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gauge symmetry breaking). Let hence put x — y 2 /N, as announced. Then 
we can rewrite the previous expansion ([5]) as 

(qi2)x = (ql 2 )y 2 - 2(gi2g23<?i3)y 4 - 

- ^(9i2923>2/ 6 + (QuiDv 6 + 6(gi2<723<734gi4)2/ 6 H ■ 

For sufficiently small y the sign of the left hand side is determined by the 
first term in the expansion, which is zero above the critical temperature but 
strictly positive below (for otherwise the replica symmetric solution would 
hold at low temperatures, which is not possible. See [HI [7] for details). 
Hence 

lim {qi2) x=y 2/ N > , (3 > Pc , 
while we already emphasized that 

lim (qu)x=o = . □ 

In other words, the limit depends on the way it is performed, and a different 
way to identify the transition is stating that the two limits x — > + and 
N — > oo (which we take simultaneously) cannot be interchanged below the 
critical temperature. Looking at ([2]) - and its consequent expansion ([5|) - we 
can see that this transition we just proved is connected with the violation 
of Ghirlanda-Guerra identities [I], when (3 > 1 and x = vs x > (we will 
deepen this further in a work still in progress at the moment). 

4 Critical indices 

We saw that, due to the gauge symmetry, the choice x — 1 /N is equivalent 
to the addition of a new spin, say numbered N + 1 (see for instance Lemma 
[1]). So could we choose in the previous section y = [3 (which makes the 
external field a proper cavity field), we would in some sense identify the 
transition by getting two different results when performing the limit as 
N — > oo of the average of the overlap for N or N + 1 spins. Unfortunately 
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in the previous section y has to be small enough and this interpretation in 
general is not possible within the proof we provided. Still, the expansion 
we illustrated can be adapted in such a way to recover the same result not 
limited to small y, and to obtain the critical exponents too. 

Roughly speaking, the idea is that even if y is not necessarily small, the 
overlaps will be small anyways, as they are always bounded by one, and 
they are identically zero above the critical temperature, at which they start 
deviating from zero with continuity. This fact, together with an explicit 
use of the gauge symmetry (as opposed to mere spin-flip) will allow for the 
reformulation of the expansion we need. 

4.1 Lower bound for the first critical index 

Critical indices are needed to characterize singularities of the theory at the 
critical point and are related to the overlap correlation functions. 
Let us introduce the expansion parameter 

r=([3 2 - l)/2 , 

and let us focus on the averaged squared overlap (qf 2 )- Assuming continuity 
in j3 at the critical point, let us also assume a behavior of the form 

<<&> ~ Ct~< . 

Once 7 is known, we can get all the other critical exponents for the higher 
order correlation functions. 

We will use convexity of the free energy density to obtain a bound for 
7 at a given C. We know that 

dja N ((3) > 

which means that the internal energy density Wjv(/3) = — dfja N (f3) is a 
decreasing function of (3 

dpu N (f3) < . 
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Therefore for every > 1, we have u{(3) < u(l). From now on we will 
restrict ourselves to the case j3 > 1. We can thus write 

-f (i - <9? 2 » < - (g? 2 >]/3=i) = 

so that 

<&> < ^ • (6) 

Using our assumption (q 2 2 ) — Cr 1 + o(r 7 ), the previous inequality ^ 
reads 

Ct 1 + o{T~f) < T + o{t) . (7) 

Now, 

• if 7 < 1, condition ([7]) is not fulfilled. In fact, if we divide by r 7 , the 
condition reads C < r 1-7 + o(l), and since 1 — 7 > 0, in the limit 
nOwe would get C < 0, which is not possible; 

• if 7 = 1, condition (|7|) becomes C < l + o(l), which in the limit r — > 
gives C < 1. 

Hence 7 > 1, and in particular if 7 = 1 then < C < 1. We are about to 
prove that 7 = 2. 

4.2 A revisited variational approach 

Let p be a generic filled overlap polynomial. With an abuse of notation, we 
follow [2] and consider the pressure, expanded in overlap polynomials, as 
a function of the polynomials with an explicit dependence on the inverse 
temperature: a((3) = a((p(/3)), (3). More precisely (see [2]) 

a(/3, (p(/3)» = In 2 + ^[1 + (1 - /3 2 )(^ 2 )] + ^{q 12 q 23 q 13 ) + 0((3 8 ) 

and we are interested in computing its derivative with respect to f3 2 . As 
explained in details in [2], the total derivative of the a(f3) with respect to (3 2 
is proportional to the internal energy of the model, and as a{(3) = —0f(J3), 
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where /(/3) is the free energy density, we derive with respect to 1 rather 
than to 0. This is just matter of tastes, after all, because it would change 
just a factor in front of our expressions below. We have 

MP, (p(P))) _ iMpMm_i 2 

dp ~ W dp ~ 4 ( {qi2)) 
and this expression needs to be equal to 

— — — = dpav, m)) + L —am) — w " 

By means of some tedious calculations that we will not report (we rather 
refer the interested reader to [5]), we get 

d MPMP))) = \{i-{il2)) , 

which imposes the following constraint 

^ d( P ) dp u ' 

where the sum on p denotes the sum over all the overlap correlation func- 
tions appearing in the expansion. From this equation, one can deduce [2] 
the Aizenman-Contucci polynomials (AC) through an approach different 
from stochastic stability (see [1]). Here we want to employ such an ap- 
proach to derive all the critical exponents of the theory within an iterative 
scheme. 

Let us take the first two non trivial orders (with (qf 2 ), (912923913)) and 
write, neglecting terms of higher order than 0(q A ) 

da{(3) d(q 2 2 ) da((3) £(912923913) = » 

d{q\ 2 ) dp + 3(^12(723913) dp ■ 1 > 

From j3]) and the first AC relation 

(9i2>-4(9? 2 92 2 3>+3(9?293 2 4>=0 
we get, when x = (3 2 /N, 

(912) - (9 2 2 )/? 2 - 2(9i29239i 3 )/? 4 - i(9i2> +6(9i29239349i4)/3 6 + 0(9 5 
(912923) = (912923913)/? 2 + (912923)/ 34 - 3(9i29239349i4)/3 6 + Q(q 5 ) . 
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Recalling Proposition [T] we also obtain 

(/? 2 - 1)( ?1 2 2 ) = 2p 4 {q 12 q 23 q 13 ) + - 6f3 6 (q 12 q 23 q 3i q m ) (9) 

(/3 2 - l)(9l29239l 3 ) = -/3 4 <<? 2 2 923> + 3/3 4 (912923934914) • (10) 

At this point the AC relations are not enough, and we need their non-linear 
extension expressed in the following Ghirlanda-Guerra identities [3] 

to deduce from l[9"])-(|10p the expression of the overlap correlation functions 
of higher orders in terms of the two-replica overlap 

P 2 (912923913) = r{q 2 12 ) + ^(qf 2 ) + l -{q 2 2 ) 2 + 0(q 5 ) , 

(912923934914) = \{q\ 2 ) + \{q 2 i2? + \r 2 {ql 2 ) + 0(q 5 ) . 
6 6 3 

Now, calling (q 2 2 ) — m 2 (/3) and noting that (912923913) ~ rm 2 (/3) ~ 

Ct 7+1 , we substitute m 2 (/3) into (jS]) and get 

rd(m 2 ) 1 d(rm 2 ) _ 
~2 d/3 2 + 3 d/3 2 = ° 

where the factors | and ^ come from the form of the expansion of the free 
energy (see [2] for details). The derivative of second term in the left hand 
side above gives 

d(Tm 2 ) _ 1 2 dim 2 ) 



—m + t- 



d(3 2 2 d(3 2 ' 

so that we obtain a differential equation trivially solvable by separation of 

variables: 

d/3 2 dm 2 



t{(3) m 2 
Integrating against d((3') 2 yields 

r/3 2 j(a>\2 rP 2 



d\og{m 2 ((3)) . 



2d{P' 
f3 2 - 1 



d\ogm 2 (P) -> log(/3 2 - l) 2 = log(m 2 (/3)) + C 



where (3 2 > fi\ > 1 and C will depend on f3\. So we finally have 
(9 2 2 ) = m 2 (/3) = C(/3 2 - l) 2 + 0(((3 2 - l) 3 ) ~ Ct 2 . 
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Therefore the critical index for the first overlap correlation function is 7 = 
2. From this, we immediately deduce 

(<712<?23<713) ~ Ct 3 

(<&) ~ C"r 4 

and so on. 

Notice that the steps we illustrated in this section provide an improve- 
ment of Theorem [21 as they allow to extend its statement up to y = (3, 
thus recovering Corollary [T] 

5 Conclusions and Outlook 

In this paper we have shown that the SK model exhibits the phase transition 
predicted by Parisi in terms of the discontinuous response of the overlap 
to the presence of and external field. A simple iterated power expansion of 
the overlaps within the cavity method allowed for the proof of the results. 
The techniques we used are extensions of those introduced and employed 
in [2] and [3] . As a result the control near the critical point of the overlap 
discontinuity in the (/3, x) plane follows, together with the computation of 
the critical exponents of the overlap correlation functions. 
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